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APTITUDE-TREATMENT INTERACTIONS IN TWO STUDIES OF 
LEARNING FROM LECTURE INSTRUCTION 
' David C. Berliner 

Far West Laboratory for Educational Research and Development* 

Whether "live", on film, or on television, the presentation of 
information by lecture is usually associ ated v/i th only tv/o acceptable 
classes of beiiavior by students: (1) note-taking, and (2) the catagory 
of behavior cal led " paying attention", Other kinds of student behavior 
are usually considered inappropriate v/hile a lecture is in progress. 

A critical analysis of both note-taking and paying attention has 
been provided by Berliner (1968, 1969). 

While note-taking and paying attention may be considered two 
different, quite prevalent, and not necessarily optimum treatments fnr 
subjects attempting to learn from lecture instruction, still a third 
behavior can bo suggested fur subjects in a lecture situation. This 
behavior involves answering questions during a lecture presentation. 
Rothkopf (1965, 1966), Rothkopf and Bisbicos (1967) and Erase (1967), 
have consistently shoivn the facilitativo effect of questions inserted into 
prose material. The questions seem to servo as notivational stimuli, v/ith 
both arousal and associative outcomes (Fraso, 1970). The covert activities 



* Study 1 was riaoe possible by the liolp of students and staff at 
San Jose State College. In addition, Deborah Kearney and Lois 
Berliner served as assistants on that study. The replication of this 
study was aided by members of the University of Massachusetts staff. 
Assistants on that study were Angelica Huber Robertson and Jack Lockhoad. 
Hr. Fred J. Dowaliby provided invaluable assistance ip the statistical 
analyses of these studies. 
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which the learner is believed to engage in when test-like events occur 

throughout prose material has been called matheniagenic behavior (behavior 

which gives birth to' learning) . Facilitative mathemagenic behaviors may 

occur in oral instruction, as with prose instruction, when test-like events 

are used. An extended rational for that point of view, accompanied by 

empirical data may be found in Berliner (19f8), while a less detailed 

description may be found in Berliner (1909). Some prelirn’nary supporting 

evidence is also offered by the work of Sanders (1970). Thus three treatments 

note-taking (NT), pacing attention (PA), and answering 'juestions, i.e., 

test-like events (TLEs), eac^h v.ith its own advantages and disadvantages, 

may be thought applicable to promote learning from lecture instruction. 

V.tien two or more treatments can be hypothesized to bo disparate 

enough to affect different types of people in different ways, the situation 

is particularly amenable to analysis of aptitude-treatment interactions 

(ATIs). Cronbach and Snow (1969), in the most comprohensi vo review 

and prograninatic study of ATI to date, have stated the problem as follov/s: 

Assume that a certain sot of outcomes from an educational program 
is desired. Consider any particular instructional treatixnt. Jji 
v/hat mann er do the charact crist i cs of learners affe ct tlic e.xte/LLIto^ 
whTcTi they attafn Vhe o'uTconibs froii T ca Hi iLOJl£ re ajrw n ts jlh at 
mi gTm >o co nlT*de}^d ? 0 r~, ' cons i deVi n g~ a p'a r tic u 1 a r lea r*n e r , irll 

trca lTn'enT Is ( 1 969 , p . 6 ) . 

Aptitude in this approach is defined as any individual difference 
characteristic Utat increases or impairs a learner's probability of 
success in a given instructional treatriwnt. The researcher's task is to 
discover aptitudes that interact with treatrents. 

Snav and his colleagues (1966) successfully demonstrated ATI 
where the personality variables of ascendency and responsibility in- 
teracted with live or filmed treaUnents, Snorr and Salomon (1968) 
pointed out the importance of the ATI appt'oach in media research. Tttat 
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work along with Walberg (1969), Koran (1968), Bundei'son (1969), Coffing 
(1970) and others cited by Cronbach and Snow (1969) and Bracht (1969) 
present evidence demonstrating that the search for Alls is difficult, 
but neither fruitless nor pedestrian. When interactions occur, a 
decision maker may assign Ss to treatments so as to optimize the 
learning environment for different groups of students. 

However, the ethereal nature of Alls must be acknowledged. Ripple 
(1968) failed in numerous replications to find a hint of an ATI. Bracht's 
(1969) study, containing an excellent overview of the field, likewise 
failed to find Alls. Neither Hamilton (1968) nor Alvord (1968), in 
well designed, well executed, and well analyzed studies, uncovered the 
ATI effects they sought. Clearly much conceptual work needs to be done 
after a full range of aptitudes have been explored within different learnitig 
tasks, taught in different ways. 

This paper describes two studies in learning from lecture instruction 
wherein the NT, PA, and TLE's treatments described above were hypothesized to 
interact with certain memory abilities. 

Study 1 

Method 

Suf^jects. The Ss v;ere predominantly female (70?) and predominantly 
freshrien (84?) at San Jose State College in California. Most Ss volunteered 
to participate, though some Ss were required to participate in experimenls 
for grades. After Ss chose particular days and hours, treatments and facilities 
were randomly assigned to time blocks. Approximately two hours were required 
of the ?11 subjects during the immediate testing. One week later, an 
additional 30 minutes were required for delayed testing (H=163). Because of 
the time consuming and rather uninteresting nature of the first cxpei imental 
s session, the 19? mortality rale was not unexpected. 
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Materials and Procedure . Aptitude information was obtained before 
Instruction began. All Ss took a Short Term Memory Test, a smaller version 
of the Auditory Letter-span Test available in the kit developed by French, 
Ekstrom and Price (1963). In addition a test of Memory for Ideas, developed 
by Seibert, Reid and Snav (1967) was used. In this test Ss v/ere asked to 
listen to a short prose passage taken from a magazine end then record the 
story. Two stories, one technical and highly factual, the other about the arts 
made up the two parts of the test. Central ideas (key v/ords) were scored one 
point each. It is a test of more than memory, to some extent the abMity to 
"integrate" a story would s^em to be involved. These tests, the Short Term 
Memory Test of letter-span and tlie Memory for Ideas Tost v;ero the tv;o 
aotitudo variables used in this study. 

The lecture material for this study was a 45 minute video-taped over- 
view of Chinese history, comprised of 18 segments, each about 2.5 Minutes in 
length, and each concerned with a different dyna.- :y or clearly delineated 
period of Chinese history. The activity associated with the video-taped 
presentation of the lecture was the independent variable. The three experi- 
nental groups had different schedules of questions to bo answered in writing 
during the lecture. Group 1 received a short-answer recall question every 
2.5 minutes, after each lecture segment. Group 2 received questions after 
five minutes of the lecture, one question on each of the preceding two segments 
Group 3 received questions after 15 minutes of the lecture, one question on 
each of the preceding six lecture segments. The S's response booklet provided 
for knowledge of the correct response for each of the eighteen questions 
v/hich they received. Two comparison groups were used to examine 'he effects 
of the various questioning techniques. Group 4 took notes and Group 5 was 
instructed to pay attention during the lecture. After Icctui'o instruction 
had ended for them the comparison groups attempted the same questions as the 
experimental groups. f- 



Two forms of a criterion test were develooed {A and 6). All Ss 
received an immediate criterion test, CT-AI or CT-BI, and one week later 
took the identical test as a delayed criterion test, CT-AD or CT-BD. The 
CTs contained 26 short-answer items, varying in point allotment of from one 
to eight points. Before attempting any of the CTs, Ss were instructed to 
review the lecture material either mentally (Group 5), through notes (Group 4) 
or by looking over the questions which occurred during instruction (Groups 1-3). 
Performance on the CTs was the dependent variable. 

Resul ts and Discus sion. The development of the A and B forms of the CT, 
the reliability of the forms and scorers, and the results of analysis of 
variance for those data has«beon presented elsewhere (Berliner, 1968; 1969). 

A summary of the it'portant data and analyses is provided in Tah-le 1. Hwever, 
this re-examination of the data was undertaken to investigate the possibilities 
of apti tude-tt'eatment interactions, for v/l'.ich analysis of variance is not the 
most appropriate statistical proredure. Following the recommendations of 
Cronbadi and Snow (1969), regression analyses were used to analyze the inter- 
actions between aptitudes and treatments. The logic of the regression 
analyses described below is as follows: First a tost of honogeneily of 

variance among tlie troatment groups was applied, followed by a tost of common 
slope, or parallelism of regression. Hie hypothesis of common slope was 
rejected if F exceeded tlio .05 level of significance. Following a significant 
F test, the Johnson-Hoyman (1936) technique was applied. In those analyses 
only the single predictor-single criterion case of the Johnson-h'oyman technique 
was used. Exploratory analysis using multiple regression deronstrated no 
increases in variance accounted for when variables wore added to the multiple 
regression equations. Ihus the slight increase in precision to be gained scored 
not to Jistify the more complex analysis requiring the interpretation of 
ellipses or parabolas. 

Coiiputir.g fonnulas for the Jchnson-Noyrvm technique were obtained from 
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Walker and Lev (1953), with modifications proposed by Potthoff (1964) to 
determine a simultaneous region of significance. The unmodified Johnson- 
Neyman technique is. quite liberal in defining a region of significance, while 
the Potthoff modification is more conservative. In this work, in one analysis, 
the region described by the John son -Neyman technique at ^=.15 was equivalent 
to the region described after Potthoff 's modification of ‘^=.05. This coincides 
with a comparison of the two techniques made by Cahen and Linn (1970). further, 
the more conservative technique seemed called for because it allows inferences 
to be made about all points within a region, rather than for single points, and 
because multiple comparisons (TLEs vs NT, TLEs vs PA, NT vs PA) were used, thus 
slightly decreasing the Icvbl of confidence involved in each comparison. The 
kind of decision making which occurs in this analysis is different fron; 
traditional inferential model. Thus Potthoff (1964) and others recommend using 
an or 90% level of confidence. All analyses reported below were made at 
the 90% level of confidence. The computer program (Dowaliby and Berliner, 1970) 
provided tests of all assumptions as well as regression equations and plotting 
points for any significant interactions between aptitudes and treatments. All 
regression equations computed for Study 1 are reported in Table 2 . Figures 
are provided for significant interactions. 

Inserr Tables 1 and 2 about here 

figure 1 displays the regression of CT-Si on the Short Term I'cmory Tost 
for the NT, PA, and TLEs groups. For the NT and TLEs regression linos the 
assumption of homogonity of variance was mat, and the hypothesis of comncn 
slope aneng the two treatnent groups was rejected; f=7.09, df=l/36, p=.009. 
Application of the nodified Johnson-Noynan teettnique (oC=.10) to the disordinal 
interaction occurring between those two regression lines described a region of 
non-significance between 5.86 and 20.11 on the X axis, around a point 
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. . TABLE 2 

Regression Equations of 
For Each Treatment 

\ 

Regressed Variables 

CT-AI on Short Term Memory 
CT-AD on Short Term Memory 
CT-Al on Memory for Ideas, Part 1 

CT-AD on Memory for Ideas, Part 1 

CT-AI on Memory for Ideas, Part 2 

CT-AD on Memory for Ideas, Part 2 ^ 

CT-AI on Memory for Ideas, Full Scale 

Scale 

Ct-BI on Short Term Memory 
CT-80 on Short Term Memory 
CT-BI on Memory for Ideas, Part 1 
CT-BU on Memory for Ideas, Part 1 
CT-BI on Memory for Ideas, Part 2 
CT-BD on Memory for Ideas, Part 2 
CT-BI on Memory for Ideas, Full Scale 

Memory for _I_dea 5. , Fu 1 1 S c a 1 c 

Combined A and B CT-I on Short Tcnn Memory 

Coirihincd A and B CT-D on Short Tcnn Memory 

Combined A and B CT-I or Memory for Ideas, Part 1 

Combined A and B CT-D on Menrory for Ideas, Part 1 

Combined A and B CT-I on Memory for 'dcas, Part 2 

Combined A and B CT-D on Memory for Ideas, Part 2 

Combined A and B CT-1 on Memory for Ideas, Full 

• - 0 
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of non-significance’ (the cross-over point) occurring at 9.10. The 
region of non-significance contained of the Ss while 23 Ss or 

57.5% of the Ss fell below the region of non-significance. With 90% 
confidence it can be stated that those Ss belav 6.86 on the Short 
Term Memory Test should be assigned to the TLEs treatment. With 
Ss of relatively poor short term rremory the use of TLEs seems to act 
as a memory aid. ' NT appears not to be an effective treatment at these 
levdls of measured memory ability. Hcn-;ever, from 50% confidence at 
9.10 to some higher confidence level (though belcx/ 90%) it would 
appear that NT is a better treatment than TLEs at the higher levels of 
memory ability. Though "common sense" might recomncnd taking notes 
if one's memory is limited, a psychological interpretation based 
on these data could contradict this, suggesting that proficiency in 
note-taking requires continuously holding new information in rrerrory while 
writing notes on material previously communicated. Note-taking is 
apparently quite useful for Ss skilled enough to handle the fremory 
requirements. It appears to by dysfunctional for Ss loiv in short term 
neirory ability, for these Ss , TLEs may provide the aid to memory that 
they require. Though not significant, (F=2.55, df=l/32, P=.12) the hint 
of a disordinal interaction in Figure 1 between PA and NT indicates that 
even PA mlgiit be a bettor treatment than NT at the very lov;est levels of 
the short term rremory continuum used in this study. Furthernore , if the 
range of scores in the PA group v.'cre greater, PA might ultirr>ately bo a 
better .technique than TLF for high a^'nity Ss. These particular relation 
ships become clearer later in this discussion. 

insert Figure 1 about here 

Figure 2 displays essentially the same relationships between short 
^ ortTi memory and the 8 form of the delayed criterion lest, CT-BD, 

cHJC 
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Fig, 1. Regression of CT-BI on Short TenTi Memory Test (Study 1), 
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2. Repression of C7-RD on Short Tern Merrory Test (Study 1). 
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administered 1 week after instruction. The hypothesis of common slope 
among the NT arid TLE treatments was rejected, F = 4.84, df = 1/32, 
p = .03, and the assumption of homogeni ty of variance was met. However, 
application of the modified Johnson-Neyman technique for the 

disordinal interaction indicated by the regression lines of the TLEs 
and NT groups failed to define a region of significance. The stability 
of the slopes over one weeks time was reassuring, as was the continued 
rejection of parallelism. With confidence ranging from 50^ at the point 
of cross-over, to something less than 90'/ confidence at the ends of 
the regression slopes it could again be noted that when short term 
memory ability is low, TLEs iseem to act as a memory aid. VIhen memory 
ability is quite high, NT seems to bo a more effective treatment. PA 
appears to bo relatively ineffective, but extension of -this 
regression lino, assuming that the slope would remain the same if Ss 
existed at the High and low ends of the scale, might indicate that PA 
was a more effective treatinent than NT when reirory aptitude v;as low 
and that PA was a more effective technique than TLEs when meriory 
aptitude was quite high. 



Insert Figure 2 about here 



O 
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In Figure 3 are the regression linos of CT-BI on the F'omory for 
Ideas Tost, Part 1. Two disordinal interactions appear to occur among 
the three regression linos. The hypothesis of cormn slope between 
the NT and TLEs treatnients was rejected; F = 9.09, df 1/36, p = .005. 
The assumption of homogeni ty of variance- was met, Application of the 
modified Johnson-Neyman procedure (.^ .10) to the disordinal inter- 
action which occurs between these two regression linos yields a point 
of non-significance at 24.97, with a region of non-significance beU,’ccn 
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20.87 and 39.55. Twenty-one Ss, 52.5% of the sample fell belov; the 
region of non-significancei Indicating that with 90% confidence Ss 
below 20.87 on the X.axis will benefit more from the TLEs treatment 
than from the NT treatment. These data, using a related but quite 
different aptitude measure, substantiate the data presented in Figures 
1 and 2. Again the usefulness of TLEs 1s demonstrated when memory 
aptitude Is low, in this case the more cognitive memory ability 
measured in the Memory for Ideas Test. Once again NT appears to be the 
more effective treatment for Ss with high memory ability, though the con- 
fidence In that statement Is considerably less than 90%. 

Insert Figure 3 about here 



Of particular interest in Figure 3 is the apparent disordinal 
Interaction between regression slopes for the PA and NT treatments. The 
hint of this relationship existed in Figures 1 and 2 when short term 
memory was the aptitude variable. No'W, In Figure 3, this interaction 
is clearer v/hen the Memory for Ideas Test, Part 1, is the aptitude 
variable. However, the hypothesis of parallelism was not rejected*, 

F = 3.20, df = 1/32, p = .08. The modified Oohnson-Neyman technique 
applied to this situation failed to yield a region of significance, all 
cases falling within a region of non-significance. This was not the case 
when the delayed CT was analyzed, as Figure 4 makes clear. 

Figure 4 displays the regression of CT-BD on the Memory for Ideas 
Tost, Part 1, for the NT, PA, and TLEs troatmonts. Once again two 
disordinal interactions appear to occur anong the three regression 
lines. The hypothesis of common slope betv;cen the NT and TLEs treatrenl 
was rejected; F = 10.09, df = 1/32, p = .003. Iho assumption of 



O 



homogeneity of variance was rot and the modified Oohnson-Neyman technique 
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Memory Tor ldeos,Porl I 

Fig. ?. Regression of CT-Bl on Memory for Ideas, Part 1 (Study 1). 





Memory For Idtr^s, Pori I 

Fig. 4. . Regression of CT-BD on Memory for Ideas, Part 1 (Stud/ 1). 
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(j(= .10) appl ied to this interaction described a region of non- 
significance between .20 .79 and 35.30, with the point of non-significance 
occurring at 24.65 on the X axis. Seventeen Ss or 47. 2X of the sample 

fell belwv the region of non-significance. For these Ss we can predict 

\ 

with 9055 confidence that a treatment incorporating TLEs v/ould be more 
beneficial than a treatment calling for note-taking while learning from 
lecture instruction. No significant differences between these two • 
treatments is evident above 20.79, but once again the previously des- 
cribed trends are substantiated and with somewhat greater confidence than 
d»ance it can be predicted that NT is more effective than_ TLEs when 
memory aptitude is high. ’ 

Insert Figure 4 about here 

The disordinal interaction occurring between tlie PA and NT 
treatments is even more interesting from a metliodological point of 
view. The modi ficd Johnson -Neyman procedure (p(= .10) defines a region 
of non-significance between 14.04 and 27.30 around a point of non- 
significance at 20.48 on the X axis. Eighty-four percent of the Ss in 
this sample fell within this region. However, SX of this sample fell 
below this region and fell aiiove this region of non-significance. 

Thus wo may conclude with 9QX confidence that for Ss with a nemory 
ability score below 14.04 P/i is the nore beneficial treatment and again 
with 90% confidence wo may conclude that for Ss wilJi a memory score 
above 27.30 NT is the more beneficial treatment. The trends noted in 
Figures 1-3 with regard to the relationship of PA and NT are accentuated 
here because in this analysis the slope of the PA regression lino has 
become negative. Within the region of non -significance, from 14.04 to 
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27.30, one can assign Ss to one of the two treatments as one moves in 
towards the point of non-significance (20.48). This is done with de- 
creasing confidehce until at that point, the two treatments yield equal 
predictions and only, chance or 50 % confidence can be put into any decision 
about assignment to these two treatments. 

The results and discussion of Figures Ithrough 4, concerned with the 
regression of the B form of immediate and delayed criterion tests on the 
Short Term Memory Test and the Memory for Ideas Test indicate that the 
following generalizations are appropriate: 1) then memory ability is high, 

NT is an effective learning strategy. For Ss witii low memory scores it is 
not recommended; perhaps it is even dysfunctional. 2) V.hen memory ability is 
la/, the presence of TLFs aid learning from lecture instruction. As nemoty 
scores increase, the usefulness of this technique is vitiated, perhaps even 
becoming dysfunctional. 3) In comparing the two "standard" forms of student 
behavior, NT and PA, it appears that PA is a more effective learning strategy 
than NT when memoty ability is low. The reverse is true if nemory aptitude 
is higfi, where NT appears to be markedly superior to PA; 4) TLFs appear to 
bo a n’ore useful strategy than PA at almost all Icvois of memory ability, 
thou^i at the very highest levels the diffet'cncc is least. PA may even be 
superior to TLFs at the very hic^iost levels of memory ability if extra- 
polation of the PA regression line is possible. 

Using the fiomory for Ideas Test, Part 2, which is less technical and 
provides a more general story for Ss to remorber, we found no interactions 
with treatments when the B form of the CT was used. 

The full scale Menxity for Ideas Tost wa'.. analyzed by regressing CT-Bl 
and CT-BD upon it. The full scale scorc was the sum of parts 1 and 2 
of the test. Figures 5 and 6 display these data. 
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A test of common slope for the regression lines of the NT and TLEs 
treatments presented in Figure 5 v/as rejected; F=5.7C, df=l/36, p=.02. 

The assumption of homogeneity of variance was met. A region of non-signi 
ficance was described extending from 35.54 to 132.24 on the X txis around 
a point of non-significance at 42.94. Nineteen Ss or 47. 5X of the cases 
In this sample were below the region of non-significance. The PA and NT 
Interaction did not reach significance; F=3.33, df=l/32, p=.07. 

Insert Figure 5 about here 

The analysis of the delayed CT presented in figure 6 was similar. 

A test of common slope of th/5 regression lines for the NT and TLEs 
treatments was rejected; F=5.91, df=l/32, p=.02. Homogeneity of vari- 

V 

ancc existed. One third of this sample, 12 Ss, fell belov; the region of 
non-significance which extended from 34.86 to 104.75 around a point of 
non-significance at 42.36 on the X axis. The PA and NT interaction did 
not reach significance; F=3.90, df=l/21, p=.06. 

Insert Figure 6 about here 

The results and generalizations made with regard to Figures 1-4 
arc congruent with the data reported in Figures 5 and 6 using the regres- 
sion of CT-BI and CT-BO on the full scale Memory for Ideas Tost. With 
90% confidence it i- predicted Uiat Ss whoso memory for ideas scores fall 
below 3b points would benefit more from treatments incorporating TLEs 
than from taking notes. Ho'.jcvcr, the point at w-hich NT significantly 
exceeds TLEs is far boyone the range of those data. The relationship of 
PA to NT described above appears to hold, but in those analyses was 
non-sigiiificant. 
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Fig. 5. Regression of CT-Bl on full scale Menx>ry for Ideas (Study 1), 
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Fig. 6. Regression of CT-BD on full scale Renioty for Ideas (Study 1). 
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All analyses of Form A of the CT provided non-significant results. 

The' regression equations in Table 2 provide all the necessary data for graphing 
these findings. Essentially six of the eight analyses using Form A of the CT 
yielded non-significant interactions between the NT and TLEs treatments. 
However, the regression lines did cross and shov/ed the TLEs group to have a 
higher predicted CT score at low menwry ability levels and the NT group to have 
a higher predicted CT score at high levels of memory ability. Thus, these 
analyses are supportive of the analyses of the B form data. No interpretation 
of the Form A data with regard to interactions involving the PA group is 
warranted, since the regression slope of the PA group was quite variable. 

As noted above the A and B forms of the CT are randomly parallel tests 
following modern test theory procedures outlined in Hagnusson (1967). The 
tests do not m?et the classical criteria for parallel tests. If classical 
notions of parallel forms may bo ignored, t)te pooled data from these two 
fonns is appropriate to use. These analyses were, therefore, also performed. 

The trends noted in Figures 1 and 2 using only the Form B data held 
for the regression of conhined A and B form data on short term moiiory in both 
imnediate and delayed tests. In this analysis, hoivever, the results wore 
non-significant. The regression of the conhined CT-I data on Memory for 
Ideas, Part 1, is displayed in Figure 7, v;hile the regression of CT-0 corfcined 
data on Memoty for Ideas, Part 1, is displayed in Figure 8. These two 
figures shw similar findings. The hypothesis of common slope between the 
NT and TLEs regression linos in Figure 7 was rejected; F'^7.70, df=l/77, 

■ p=.007. In Figure 8 the hypothesis of common slope for these two 
treatments was also rejected; F-6.36, df=l/67, p=.01. The assumptions of 
homogeneity of variance were met in both cases. In Figure 7 a region of 
non-significance was described by the modified Oohnson-Heyman technique 
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extending from 20.67 to 45.29 around a point of non-significance at 25.33 
On the X axis. With. 90% confidence it can be stated that the 43 Ss , or 
53.1% of this sample who fell below 25.33 on the aptitude test would 

benefit more from a treatment incorporating TLEs than one reqiiring NT. 

\ 

In Figure 8 a region of non-significance was described extending from 
15.02 to 38.80 around a point of non-significance at 22,32 on the X axis. 
In this case 13 Ss , or 18.3% of the sample fell below the region of' 
non-significance, indicating that with 90% confidence Ss scoring belav 
15.02 points on this memory aptitude test would benefit more from a 
treatment incorporating NT than one utilizing TLEs. This relationship 
is stable over the one week »delay between tests as may be noted in the 
figures. The relationship between PA and NT described in Figures 7 
and 8 is quite weak, but compatible with previous discussions. 

Insert Figure 7 about he*r 

Insert Figure 8 about here 



The regression equations used in analysis of the l■’cmory for Ideas 
Test, Part 2, are presented in Table 2. Though all analyses were non- 
significant, no rcvei-sal in the trends already noted occurred when 
graphic displays of the data were analyzed. 

Iho full scale Temory for Ideas Test v/as analyzed by regressing 
immediate and delayed conhined CTs upon that romory test and the results 
are presented in Figures 9 and 10. For Uic inrodiatc CT, Figure 9, 
two disordinal interactions which occurred among the three Ireatronts 
were significant. The hypothesis of coninon slope was rejected between 
the in and TLEs treatnents; F=6.38, df=l/77, p».01. The modified 
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Fig. 7. Regression of CT-AI and CT-Bl, combined data, on Memory for 
Ideas , Part 1 (Study 1) . 
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Fig, 8. Regression of CT-AR and CT-BD, corbinod data, on Menory for 
Ideas , Part 1 (Study 1 ) . 21 



Oohnson-Neynian technique described a region of non-significance from 
35.46 to 91.39 around a point of non-significance at 42.81. The 
assumption of homogeneity of variance was tested and accepted. For the 
39 Ss, or 48. U of the cases v/hich fell below the region of non-signifi- 
cance, it can be stated with 9Q% confidence that they v/ould benefit more 
from a treatment incorporating TLEs rather than a treatment requiring NT. 

If .the comparison of treatments is between NT and PA, it is 
hypothesized that, with 90% confidence, Ss would benefit more from NT 
than PA if their memory aptitude test score is above 34.36. For this 
comparison the hypothesis of common slope for the two regression lines 
was rejected; F=5.19, df=l/68,. p=.02. The modified Oohnson-Neyman 
technique described a region of non-significance between -184.84 and 
34.36 around a point of non-significance at 27.21 on thC' X axis. Thirty- 
five Ss, or 48. 6X of this sanple were above the region of non-significance 

Insert Figure 9 about here 

Once again it appears that TLEs is a viable technique for Ss Icn; 
in this memory aptitude, while NT is a viable technique for Ss high in 
this nemory aptitude. Thc'.e relationships arc not as strong v;hen the 
delayed CT v;as examined, as illustrated in Figure 10. In that case, the 
interaction between NT and TLEs was significant, with a test of parallel is 
beU/een the two regression slopes providing an F ratio of 5.94, df=l/67, 
p=.02. The region of non-significance was quite extensive, from 25.74 to 
64.58 around'a point of non-significance of ."^8.03 on the X axis. Never- 
theless, seven Ss, 9.9% of the cases, did fall below tlie region of non- 
significance. Thus a v.'caker, but LoScntially similar relationship exists 
as that described for the data from the Imedialo test presented in 
Figure 9. The interaction bclv.’cen NT and PA v/as not significant, but as 
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illustrated in Figure 10 it is corripatible with the previous discussion. 

Insert Figure 10 about here 

The summary of Study 1 will be postponed until after the results 
of Study 2 are presented and discussed. 

Study 2 

The findings of Study 1, if replicable, would be important 
theoretically and could have practical implications for the design and 
conduct of lecture instruction. VMth some modifications, a replication 

of Study 1 was thus undertaken. 

♦ 

Method 

Subj ects. A total of 211 Ss wore draivn from atrong those students 
- enrolled in basic psychology at the University of Massachusetts. Mean age 
was 18.6 years with a range of 17-28 years. Most Ss v;ere sophomore 
liberal arts majors, though all classes and majors wore represented. 
Forty-three percent were male and V!% Vrcre female. A personal history 
form was completed by the Ss . Analysis of those data revealed that there 
v/ere no differences among Ss in the vario'js treatments for the variables: 
year in school; academic major; sex; age; and previous history of exposure 
to the subject matter used in the oxperimonlal lecture. The Ss signed up 
for tv;o sessions v/hich wore given on the same weekday, on successive 
v/ecks during the fall of 1969. Conditions v/ore assigned randomly to time 
blocks. 

Mat eria ls and Procedure. In addition to the two aptitude tests 
described in Slucjy 1, a third aptitude lest, Memory for Sentences, was 
added. This aural lost presented Ss with conplele sentences of varioits 
length, and required verbatim recall in/odiately after each sentence. 
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Fig. 9. Regression of CT-AI and CT-BI, Conijined data, on full scale 
Ketnory for Ideas (Study 1). 




Full Scot© Mcmof)' Fof Ideos 

fig. 10. Rcgrossfon of CT*A0 end CT*CD, Corfiincd data, on full scale 
Memory for Ideas (Slody 1). 




24 



Berliner 25 

Tliis test, like the Memory for Iceas Test, v/as developed by the Purdue 
research group (Siebert, Reid and Snw, 1967)< This test was added to 
represent short term nemory ability for meaningfully connected verbal 
material, less complex than that represented by the Memory for deas Test. 
Unfortunately the battery of apti tude tests had to be given after 
instruction because of time limitations on the use of the Ss. All tests and 
instructions were administered by audio tape^ 

The lectu^'e material was a 30-minute overview of Chinese history, 
in which the 18 segments used in Study 1 wore reduced to 12 two-and-one- 
half minute segments. The lecture was presented via videotape through 
large television monitors in J.he experimental room. Only three experimental 
groups v/cre used: TLEs , NT and PA. The B form of the test described in 
Study 1 was used as a CT; it was administered as CT-I (ininediate) or CT-0 
(delayed). Procedures for processing the three groups were essentially the 
same as i n Study 1 . 

R esults and Discussi on. Pearson correlations between scorers of 
the CTs and aptitude tests average about .90 in separate chocks of relia- 
bility. Tost-retest reliabi lity was also high, for the three treatnents 
the correlations between irrimiodiate and delayed tests wete .90, .92 and .84. 
Table 3 presents reans, standard deviations and the nunbers of Ss per 
treatment. The results of an F test fiem an analysis of variance and 
associated significance levels arc also presented for these data. Post hoc 
analyses using the Newman-Kouls procedure are presented (column N-K). 

Insert Table 3 about here 

In analysis of both CT-I and CT-0 a significant between treatnx;nt 
difference was found. Overall the PA group, in both iniTOdiate and 
delayed testing, did poorest again. The TLEs group which is 
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TABLE 3 

Descriptive Statistics and Summary Analysis 
of the CTs Used in Study 2 



Study 2 







Treatment 










TLEs 


NT 


PA 


F test 


N-K 


H 


24.60 


^4.53 


19.16 ' 


7.79** 


TLEs>PA* 


CT-I SO 


9.59 


8.12 


10.87 




NT>PA* ■ 


N 


67 


__5J 


__8A 






M 


21.87 


24.53 


17.48 


11.95** 


TLEs>PA* 


CT-D SD 


8.34 


8.15 


9.44 


. 


NTSPA* 


N 


67 


68_ 


86 







*P .05 

**P .01 
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as' pov/erful as the NT group in immediate testing appeared less effective 

on the delayed test. As indicated in column M-K of Table 3, in both 

immediate and delayed testing the TLEs and NT groups did not differ 

statistically among themselves but vfere significantly different from the 

\ 

PA treatment. These findings are quite si mi liar to the findings reported 
in Study 1, The NT group '.s remarkable retention on the CT after one 
week's time deserves special mention. An earlier investigation (Berliner, 
1968) reported a reminiscence effect with virtually identical material, 
and once again this material by treatment interaction seems to yield a 
reminiscence effect. Replication of conditions producing reminiscence 
are themselves worth further ^investi gation. 

Since aptitude tests were administered one week after instruction 
and immediate testing, aptitude scores were examined for possible treat- 
ment effects. No significant differences bcU/oon treatments were found 
using simple one way analyses of variance. As noted in Table 4, means 
and standard deviations for the tests in each treatment are quite hono- 
genous. 

Insert Table 4 about here 




Regression analyses were per formed using the pi'ocedures noted 
above. All regression equations for all analyses of Study 2 arc pre- 
sented in Table 5. Figures 11 and 12 illustrate the irportant results, 
tssontially the sem? relationships as those in Figures 1 and 2 ate 
displayed. The stability of the Alls described in Stuc|/ 1 is quite 
distinct. For the regression of CT-1 on the Short Tenn I'crory Test 
(Figure 11) the hypothesis of conaon slope is rejected with regard to 
the NT and UEs interaction (F=S.17, df=l/12l, p-.02). The assumption 
of hor.Dgencity of variance was niet and application of the modified 

27 



Berliner 28 



TABLE 4 

Descriptive statistics for tlie Aptitude Tests Used 
In Stucly 2 

Treatments In Study 2 





TLEs 


NT 


PA 


Short Term 


M 


6.81 


6.83 


7.29 


liemory Test 


SD 

« 


2.74 


2.23 


2.73 




Range 


3-15 


2-U 


-__2ji1_8_ 


Memory for 


H 


19.52 


19.66 


20.42 


Ideas, Part 1 


SO 


6.76 


6.61 


7.17 




, Rajijjc . 


6-35 


_ 6^3_8_ 




Memory for 


M 


13.67 


12.27 


13.76 


Ideas, Part 2 


SD 


4.18 


4.55 


4.85 








0-22 


__ 3-27 


Memory for 


- 

H 


33.19 


31.93 


34.17 


Ideas, Full 


SO 


9.22 


9.43 


9.83 


Scale 


Ryigc 




-A3- 56 


_9-_59 


Memory for 


H 


2.04 


1.84 


1.88 


Sentences 


SD 


1.34 


1.25 


1.34 




_ Range 


.. 0-A— 


__q-_5_ 


_q-6 _ 
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Johnson-Neyman technique (o^ = .10) described a region of non-significance 
between -.38 and 1,4.85 around a point of non-significance of 6.86. Only 
'one case, .8^ of the sairple fell above the region of non-significance. 
Nevertheless, the similarity between the regression analyses for Study 1 
and Study 2 is clear. With confidence varying between 50^ and 90% it may 
be repeated, v/ith increased assurance , that when short term memory 
ability is low, treatments Incorporating TLEs are recomfrended. Conversely, 
when this memory ability is high, NT is recommended. 

-Insert Table 5 about here 



-•Insert Figure 11 about here 



Insert Figure 12 about here 

Regression data for the delayed CT on the Short Term Memory Test 
(Figure 12) once again supports previous findings. In this case the 
hypothesis of common slope between the NT and TtFs regression lines v/as 
(marginally) rejected; F=3.75, df-1/121, p=.052. Ihe conservatism of 
the modified Oohnson-Neynvm technique at t^ = .10 worked against defining 
any regions of significance. Figures 11 and 12show that the PA and TLEs 
relationships noted earlier were replicated, though again were v/cak. 

The PA and NT interactions reported earlier were not J;s distinct in this 
study.' 

The analysis of the Momory for Ideas Test, by parts, and also using 
the full scale score, uncovered no interactions with treatments. Ihe 
regression equations for these analyses are found in Table 5. Graphing 
those regression linos reveals neither support for nor marked contradiclic.i 

O . 
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TABLE 5 

Regression Equations of the Form Y=a+bx 
For each Treatment in Study 2 



Study 2 



Regressed Variables ' 


Regression Equations 




NT 


TLE 


PA 




a bx 


a bx 


a bx 


CT*I on Short Term’Hemory 


19. 91+ .68 


30.14- .81 


19.85- .09 


CT*0 on Short Term Memory 


21.45+ .45 


26.81- .73 


16.39+ .15 


CT-I on Memory for Ideas, Part 1 


13.60+ .56 


9.31+ .78 


4.93+ .70 


CT-D on Memory for Ideas, Part 1 


13.73+ .55 


10.63+ .58 


4.21+ .65 


CT'I on Memory for Ideas, Part 2 


17. 3H .59 


16.37+ .60 


14.13+ .37 


CT-O on Memory for Ideas, Part 2 


16.98+ .62 


14.49+ .54 


13.18+ .31 


CT-I on Memory for Ideas, Full Scale 


11.46+ .41 


6.53+ .54 


3.46+ .46 


CT-D on Memory for Ideas, Full Scale 


11.37+ .41 


7.92+ .42 


3.08+ .42 


CT-I on Memory for Sentences 


20.30^2.30 


22.31+1.12 


17.44+ .91 


on .Hcmoi 7 for Sentences 


2J,. 20+ 1.81. 


_ 20.^^64+ .. 6.0 _ 


1.5..?.6_tl.._1.8. 
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Short Term Memory Test 

fig.ll. Regression of CT-I on Short Term f,en)ory Test (Study 2). 




CT-D 




Short Term Memory Teel 



Fig. 12. Regression of CT-0 on Short Term Ker:x>ry Test (Sturt/ 2) 
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of the findings in Study 1. 

The additional aptitude test used in this study, Femory for 

Sentences, vfas also analyzed by procedures previously described. The 
% 

hypothesis of parallelism between treatment regression lines v/as not 

\ 

rejected, thus no regions of significance v/ere found when the Johnson- 
Neyman technique was used. The data, while not confirming previous 
memory aptitude-treatrrent interactions is nevertheless supportive. 

Figures 13 and 14 display the obtained relationships. In the case of 
the regression of CT-I on Memory for Sentences a non-significant 
disordinal interaction between TLEs and NT treatments occurs, This 
suggests the same kind of decision rules developed in Study 1 about vrhen 
to recomnond Tl.Es and NT treatments for knenvn scores on iremory aptitude 
tests. In the case of the regression of CT-D on Memory for Sentences 
a non-significant ordinal interaction occurs, suggesting that at 
higher scot'cs on nemory aptitude tests NT is a superior treatment to TLEs, 
a finding which is also in lino with the results of Study 1. 

•Insert Figure 13 about here 



Insert Figure 14 about here 

in this study the PA treatrent was so weak that virtually any 
• possibility of disordinal interactions occurring with other treatrents 

was renotc. However, as noted in Figures 11 and 13, at the lo^.'cr levels of 
menory ablHlity the difference in predicted CT score for tJic NT and PA 
treatments is considerably less tlian v.hcn rerory ability is high. IhiS 
trend was noted in Study 1. Though this relationship was not pbvious 
in the delayed testing (Eigures 12 and 14), Uio results do not contradict 
interpretations which were offered in Study 1. 
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CT- 




Memofy For Sen(er>cos 

Fig. 13. Regression of CT-1 on F'ernory for Sentences (Study 2), 




Mg. 14. Regression of CT-D on Merory for Sentences (Study 2). 
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Sununa r y and Conclusion 

Work has already been done on a third study, using related learning 
materials. Studies f and 2 have demonstrated Alls that are stable over time 
(immediate and delayed) and over samples (San Jose State and University of 
Massachusetts). The third study of this series will investigate if the Alls 
generalize across subject matter areas. At this time we may state that 
previous discussions of the main effects (Berliner, 1968, 1969) must bo 
riwdified in light of the Alls found in these studios. Snow's (1970) classifi- 
cation of Alls as being either of the preferential or compensatory rodels, 
leads to the conclusion that^the TLEs - NT interaction seems to fit the compen- 
satory model. TLEs may function as a menory aid lo Ss low in memory ability 
(e.g. figures 1-4, 11 and 12). The typically high correlation between memory 
scores and CT scores found in the NT treatment (e.g. r=.72 bebvoen Memory for 
Ideas, Part 1, and CT-8I) indicates a strong relationship between the menory 
tost and CT performance after taking notes. But that relationship is 
vitiated when an S uses TLEs (e.g. r= -.03 between Menory for Ideas, Part 1, 
and CT-BI). Study 1 therefore, supports the belief that the TLEs treatment 
compensates for the lov/cr tronory ability of certain Ss, and provides a 
mechanism for them to do well on the CT. This interpretation was also 
supported in Study 2, but not as strongly. 

Hie data from these studios are supportive of the notion that TLEs 
have a place in learning from lecture instruction, provided that a Ss 
memory abilities are known. To illustrate this an expectancy table, 
folloiving Cahen's (1969) reconrendations , has been developed. Table 6 
gives the predicted CT score for the NT and ILEs trealnenls in Study 1, 
taking into account tlie Short Term I'omory aptitude (figure 1). This 
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relationship v/as the one .replicated in Study 2 (Figure 11). Predicted 
CT scores for the two treatments differ by approximately 1.5 to 2 standard 
deviations at the extremes. This quite clearly illustrates the importance 
and usefulness of incorporating the ATI model into instructional research. 



Insert Table 6 about here 



With regard to note-taking behavior these studies may help explain 
v/hy the literature generally points out the ineffectiveness of note-taking. 
Only at very high levels of memory ability is note-taking an effective 
learning strategy. In most instances the NT condition has been characterized 
by a steeply rising regression lino. However, the PA treatment has been 

generally characterized by a flatter slope, thus giving rise to situations in 
which, when memory ability is low, the advantage of NT over PA is minimum. 

At these levels of memory ability, in sone instances, the PA treatment is 
even superior to the NT treatrrent (e.g. Figures 1-6). A psychological 
analysis of note-taking leads to tlic hypothesis that only when nerery 
aptitude is high does one possess the ability to accurately store orally 
transmitted information for the tine necessary to transcribe it accurately. 
Likov/ise, only at such aptitude levels can one store and attend to the 
now information that is being transmi ttod whi lo transcribing any previously 
obtained information. V.lien rerory aptitude is low, these abilities are 
likely not to be present and thus it is as efficient or more efficient 
for the learner to pay attention to the lecture. 

Aptitude treatment interactions are not often found in the literature. 
TFie Johnson-Neyman (19 36) technique has rarely been used for analysis, 
thougit now that some computer progrars exist (Carroll and Wilson, 1969; 
ttowaliby and Berliner, 1970) this technique right beccrio more conmn. In 
Q fact, there is a trend lO'.'ard analysis of data thiough tiic ATI approach 





TABLE 6 
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Predicted Score on CT-BI for Certain Aptitude Scores in 
the NT and TLEs Treatments of Study 1 



Short Term Memory 
Aptitude Score 


Predicted CT Score 
in NT Treatment 


Predicted CT Score 
in TLEs Treatment 


Difference in 
Predicted Score 


3 


8.41 


21.85 


13,44 


5 


11.61 


20.65 


9.04 


; 7 


14.81 


19.45 


4.64 


9 


18.01 


18.25 


.24 


n 


21. PI 


17.05 


4.16 


14 


26.01 , 


15.25 


10.76 
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and methodology. This paper demonstrates! a nuirier of interesting ATIs in 
Study 1, and a replication of some of these in Study 2 . 

The conditions under v/hich certain ATIs hold or do not hold must be 
investigated further, and many more aptitudes must be examined for interactive 
effects. However, even at this preliminary stage it is noted that the ATI 
approach to instructional research has great potential in educational 
psychology. Clearly, the treatment main effects noted in the analyses of 
variance reported above v;ere inadequate to represent the key trends in these 

data. Further, using a simple effects analysis, after finding an interaction 

« 

with an analysis of variance, would not have produced the precision in 
locating the points at v/hich confident decisions could be made. Using the 
aptitudes an S brings to an instructional situation, and incorporating 
these into a regression approach to analysis, provides information to 
a decision maker such that Ss may be assigned to different treatments, 
each with the greatest potential for individuals with similar aptitude 
scores . 
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